Joint Sparse Representation for Robust Multimodal

Joint Sparse Representation for Robust Multimodal Biometrics Recognition Report Title Traditional biometric recognition systems rely on a single biometric signature for authentication. While the advantage of using multiple sources of information for establishing the identity has been widely recognized, computational models for multimodal biometrics recognition have only recently received attention. We propose a multimodal sparse representation method, which represents the test data by a sparse linear combination of training data, while constraining the observations from different modalities of the test subject to share their sparse representations. Thus, we simultaneously take into account correlations as well as coupling information among biometric modalities.We modify our model so that it is robust to noise and occlusion. A multimodal quality measure is also proposed to weigh each modality as it gets fused. Furthermore, we also kernelize the algorithm to handle non-linearity in data. The optimization problem is solved using an efficient alternative direction method. Various experiments show that our method compares favorably with competing fusion-based methods. Joint Sparse Representation for Robust Multimodal Biometrics Recognition Approved for public release; distribution is unlimited. 56177.215-CS-MUR REPORT DOCUMENTATION PAGE (SF298) (Continuation Sheet) Continuation for Block 13